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Abstract 

Introduction: The discharge of patients from the intensive care unit (ICU) to a hospital ward is a common 
transition of care that is associated with error and adverse events. Risk stratification tools may help identify high- 
risk patients for targeted interventions, but it is unclear if proper tools have been developed. 

Methods: We searched Ovid EMBASE, Ovid MEDLINE, CINAHL, PUBMED and Cochrane Central Register of 
Controlled Trials from the earliest available date through March 2013, plus reference lists and citations of all studies 
included in the systematic review. Cohort studies were selected that described the derivation, validation or clinical 
impact of tools for predicting medical emergency team activation, ICU readmission or mortality following patient 
discharge from the ICU. Data were extracted on the study design, setting, population, sample size, tool 
(components, measurement properties) and outcomes. 

Results: The literature search identified 9,926 citations, of which eight studies describing eight tools met the 
inclusion criteria. Reported outcomes included ICU readmission (n = 4 studies), hospital mortality (n = 3 studies) 
and both ICU readmission and hospital mortality (n = 1 studies). Seven of the tools were comprised of distinct 
measurable component variables, while one tool used subjective scoring of patient risk by intensive care 
physicians. The areas under receiver operator curves were reported for all studies and ranged from 0.66 to 0.92. 
A single study provided a direct comparative analysis between two tools. We did not find any studies evaluating 
the impact of risk prediction on processes and outcomes of care. 

Conclusions: Eight risk stratification tools for predicting severe adverse events following patient discharge from 
ICU have been developed, but have undergone limited comparative evaluation. Although risk stratification tools 
may help clinician decision-making, further evaluation of the existing tools' effects on care is required prior to 
clinical implementation. 

Keywords: Review, systematic, Critical care, Intensive care, Patient discharge, Decision support techniques, patient 
readmission, Mortality 



Introduction 

Transitions of patient care between providers have been 
identified as important routine processes of care that 
expose patients to preventable medical errors and adverse 
events [1]. The discharge of patients from the intensive 
care unit (ICU) to the hospital ward is one of the most 
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challenging and high-risk transitions of care during which 
the sickest patients in the hospital change their provider 
team (physicians, nurses, pharmacists, therapists) and are 
transferred from a resource intensive environment to a 
resource-limited environment [2]. 

Determining when patients are ready for ICU discharge 
has traditionally been dependent on the clinical judgment 
of the physician discharging the patient from the ICU 
and the physician admitting the patient to the hospital 
ward. However, there has been increasing interest in the 
development of tools to describe patient risk at the time 
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of discharge from ICU. Independent risk stratification 
may provide clinicians with additional information to 
guide clinical decision-making. Risk assessment may help 
target the delivery of resource-intensive transitional care 
interventions (for example, medical emergency teams) to 
patients at greatest risk. Intensive care unit readmission 
is increasingly used as a performance metric by many 
institutions and risk stratification models could be used 
to help benchmark such activities [3], However, there is 
no consensus on an ICU discharge risk stratification tool. 

Therefore, we performed a systematic review to 
synthesize the published literature on tools for predict- 
ing severe adverse events following patient discharge 
from ICU, describe their operating characteristics, and 
appraise their clinical effectiveness. 

Materials and methods 

We searched for studies that evaluated tools to stratify 
patient risk of severe adverse events following ICU 
discharge. We used the Preferred Reporting Items for Sys- 
tematic Reviews and Meta-Analysis (PRISMA) guidelines 
for conducting and reporting this systematic review [4] . 

Data sources and search strategy 

We conducted a systematic search of articles in Ovid 
EMBASE, Ovid MEDLINE, CINAHL, PUBMED and 
Cochrane Central Register of Controlled Trials from 
inception to March 2013. Searches were performed with- 
out year or language restrictions, and used combinations 
of the following three groups of terms: intensive care unit, 
patient discharge and severe adverse event (medical emer- 
gency team (MET) activation or ICU readmission or mor- 
tality). The search strategy for the MEDLINE database is 
depicted in Appendix A (see Additional file 1). We also 
searched references in the bibliographies of retrieved arti- 
cles and performed a citation search of all studies included 
in the systematic review (that is, articles citing studies 
included in the systematic review). Search strategies were 
constructed with the help of an experienced information 
scientist (DL), and all citations were imported to an elec- 
tronic database (Endnote X3, Thomson Reuters, New 
York, NY, USA). 

Article selection 

Two authors independently reviewed titles and abstracts 
(SH, SB) for all studies identified in the search, followed 
by full text review of articles (SH, NB), identified by 
either reviewer as meeting inclusion criteria. Discrepan- 
cies were resolved by discussion between the reviewers. 
Kappa values and their 95% confidence intervals were 
calculated for agreement between authors. 

We selected all articles that described the derivation, 
validation or evaluation of the clinical impact of a tool 



to stratify the patients' risk of adverse events following 
discharge from ICU. We defined severe adverse event as 
any one of the following: MET activation, ICU readmis- 
sion, or death during a patient's hospital stay following 
discharge from ICU. MET activation was defined as 
emergency activation of an on-call resuscitation team 
for hospitalized patients meeting specific physiological 
criteria (as defined by individual hospital policy) follow- 
ing discharge from ICU. 

Studies had to meet each of the following inclusion cri- 
teria: 1) the study described original research published in 
a peer reviewed journal; 2) the study populations were 
adult patients (majority patients >16 years) discharged 
from ICU; 3) the study described derivation, validation or 
clinical impact of a tool to risk stratify patients at the time 
of ICU discharge; and 4) the study reported at least one of 
the following three patient outcomes following patient dis- 
charge from ICU, MET activation, readmission to ICU or 
mortality. Studies not satisfying all four inclusion criteria 
were excluded from the review. We included only cohort 
studies and controlled trials. Case-control studies, case 
series and case reports were excluded. Systematic reviews 
were excluded, but their reference lists were hand- 
searched for relevant articles. Studies examining discharge 
from a high dependency or step-down unit were excluded. 

Data extraction 

Two reviewers independently performed data abstraction 
and quality assessments. Reviewer consensus was required 
for inclusion of results. We extracted data describing 
study purpose, design, setting (country, type of ICU), sam- 
ple size, study population (age, sex, illness severity), risk 
stratification tool (components, measurement properties) 
and outcomes (MET activation, ICU readmission, hospital 
mortality). Study quality was evaluated using pre-specified 
criteria (study design, patient follow-up, ethics approval, 
description of study patient eligibility criteria and charac- 
teristics, method of statistical adjustment, a priori consid- 
eration of sample size and power, study duration and 
discussion of limitations). Authors were contacted to 
request missing data. 

Data synthesis 

We analyzed the abstracted data according to validated 
guidelines for narrative synthesis [5-8]. Studies were 
grouped according to outcomes measured. We com- 
pared each tool according to: model derivation and vali- 
dation, operating characteristics and individual 
components/variables. Sensitivity, specificity and likeli- 
hood ratios were calculated using data presented in the 
article if not reported. Pooling of quantitative data was 
not possible due to the limited number of evaluations of 
individual risk stratification tools. 
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Results 

Figure 1 describes the results of the article screening 
and selection process. The literature search identified 
9,926 potentially relevant articles in five databases; from 
these we reviewed 148 full text articles and selected 



8 articles for final inclusion in the study [9-16]. The two 
most common reasons for exclusion of articles after 
full-text review were that articles did not report original 
research or did not report study outcomes (MET activa- 
tion, ICU readmission, hospital mortality). Inter-rater 



9,926 Potentially relevant articles 
identified 
EMBASE - 4752 
MEDLINE -3670 
CINHAL-1318 
PUBMED - 1299 
COCHRANE -152 



2,003 Duplicate articles excluded 



7,923 Articles for evaluation of abstract 



7,775 Articles excluded based on 
title/abstract review 



148 Articles for evaluation of full-text 



4 Articles 
identified 
from 

references 



0 Articles 
identified 
from 
citations 



8 Articles included in systematic review 



144 Excluded after full text review 
and citation search 

23 Not original research 
87 No tool/outcome of interest 
1 1 Unrelated to ICU discharge 
9 Case-control 
4 Case report/series 
4 No full text available 
3 Discharge from step down unit 
3 No comparator group 



Figure 1 Selection of articles for review 
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agreement was good for full-text review (kappa = 0.84, 
95% confidence interval 0.67 to 1.00). 

Article characteristics and quality 

Table 1 summarizes the characteristics of the articles 
included. Eight articles published between 2001 and 
2012 described eight unique risk stratification tools. The 
studies were conducted primarily in medical-surgical 
ICUs in the United States and Europe. The number of 
patients in each study ranged from 518 to 704,963, with 
a total of 745,187 patients included in the review. The 
mean age of participants ranged from 57 to 64 years 
among the studies that reported age. Acute Physiology 
and Chronic Health Evaluation (APACHE) scores were 
used to measure patient severity of illness in the major- 
ity of studies. Five studies followed patients until hospi- 
tal discharge. Among the included studies, following 
ICU discharge, ICU readmission ranged from 2.1% to 
8.3% and hospital mortality from 0.4% to 9.6%. None of 
the studies reported MET activation. 

Description of risk stratification tools 

Table 2 describes the eight risk stratification tools identi- 
fied. The Sabadell score and the tool developed by Daly 
et al. were designed to predict hospital mortality following 
ICU discharge. Reini et al. evaluated the ability of the 
Modified Early Warning Score (MEWS) to predict ICU 
readmission within 72 hours of discharge. The Stability 
and Workload Index for Transfer (SWIFT) score and the 
Frost nomogram were developed to predict ICU readmis- 
sion following ICU discharge. The Minimizing ICU Read- 
mission (MIR) score was designed to predict the combined 
outcome of patient death or ICU readmission seven days 
post-ICU discharge. Badawi and Breslow developed two 
tools to respectively predict readmission and mortality 
48 hours post-ICU discharge. All tools except the Sabadell 
score incorporated between 5 and 26 variables into their 
risk calculation with length of ICU stay the only common 
variable appearing in most tools. The Sabadell score was 
calculated by physician judgment of patient prognosis at 
the time of ICU discharge using a four-point scale. 

Evaluations of internal and external validity were 
reported for most tools. The calculated area under the 
receiver operating characteristic curves (AUROC) ranged 
from 0.66 to 0.92, with the Badawi and Breslow mortality 
tool having the highest reported AUROC (0.92). The sen- 
sitivity, specificity and likelihood ratios were reported or 
could be calculated for all the tools except the Frost 
nomogram. Gajic et al. compared the SWIFT score to 
the APACHE III score (AUROC 0.75 vs. 0.62, P <0.01) at 
the time of patient discharge from ICU. Ouanes et al. 
similarly compared the MIR score, SWIFT score and 
Simplified Acute Physiology Score II (AUROC 0.74 vs. 
0.61 vs. 0.64). 



We did not find any studies evaluating the impact of 
risk prediction on processes and outcomes of care. 

Study quality 

Table 3 summarizes study quality. All studies used a 
cohort design (four prospective, four retrospective), 
described patient eligibility criteria, reported complete 
patient follow-up and performed multivariate data analy- 
sis. The studies by Badawi and Breslow, Daly et al., Fer- 
nandez et al. and Ouanes et al. include more than one 
ICU. Half of the studies included patients with do-not- 
resuscitate orders at the time of ICU discharge. 

Discussion 

Our systematic review identified eight ICU discharge risk 
stratification tools evaluated in eight studies. Outcome 
parameters from these studies were ICU readmission, 
post-ICU mortality and a combination of both. All tools 
except the Sabadell score used patient physiological and 
clinical characteristics to calculate patient risk of severe 
adverse events following ICU discharge. The SWIFT 
score, Badawi and Breslow mortality tool and MIR score 
had the best reported operating characteristics for predict- 
ing ICU readmission, hospital mortality and the combined 
outcome of ICU readmission and hospital mortality, 
respectively. A single study compared two of the risk stra- 
tification tools. No studies reported MET activation fol- 
lowing ICU discharge as an outcome, identifying an 
opportunity for evaluation in future studies. 

Our study adds to the literature by highlighting an 
important gap in the science of patient care transitions 
from the ICU. First, it is unclear whether a reliable and 
valid risk stratification tool for patient discharge from ICU 
has been developed. We identified eight risk stratification 
tools, only two of which have been directly compared in a 
single study, where the MIR score had a better AUROC 
value than the SWIFT, although lower than those reported 
for the tools developed by Daly et al., Fernandez et al. and 
Badawi and Breslow. Furthermore, only the MIR score is 
designed to predict both post-ICU discharge mortality and 
readmission. To complicate matters it is unclear which of 
these two outcomes is most relevant. These data suggest 
that the MIR score is promising, although its use of beta 
coefficients to calculate patient risk will make it difficult 
for clinicians to use outside of a computerized algorithm. 
The ICU discharge readiness scores developed by Badawi 
and Breslow have not been compared to other tools, and 
their proprietary nature may make independent evaluation 
challenging, but their derivation and evaluation in a large 
number of patients and ICUs suggests promise. 

Second, it is also unclear how risk stratification tools 
compare to physician clinical judgment for identifying 
patients at increased risk of adverse events post-ICU. Clin- 
ical estimation is often based on subjective parameters and 



Table 1 Characteristics of included studies 



Study 


Year 


Country 


Follow-up 


Type of ICU 


# Patients 


Age (Mean) 


Female (%) 


Severity of Illness score (Mean) 


Readmission 
No. (%) E 


Mortality 

No. [%)' 


Gajic 


2008 


USA, Netherlands 


7 days 


Medical-Surgical 


2,622 


64 M 


46 M 


APACHE III {59f 


217 (8.3) 


5 (0.4) M 


Frost 


2010 


Australia 


Hospital discharge 


Medical-Surgical 


14,952 


57 


39 


APACHE II (13) 


896 (6.0) 


869 (6.0) 


Reini 


2012 


Sweden 


Hospital discharge 


Medical-Surgical 


518 


59 


46 


SAPS III (55) 


13 (3.7) 


29 (8.8) 


Badawi 


2012 


USA 


48 hours 


Mixed § 


704,963 


62 


46 


APACHE IV (47 (i ) 


1 7,874 (2.5) 


6,492 (0.9) 


Daly 


2001 


UK 


Hospital discharge 


Medical-Surgical 


1 3,924 


67-72 T 


36 


APACHE II (13) 


1 42 (2.6) M 


1,158 (8.3) 


Fernandez 


2006 


Spain 


Hospital discharge 


Medical-Surgical 


1,159 


60 


N/A 


APACHE II (20) + 


N/A 


111 (9.6) 


Fernandez 


2010 


Spain 


Hospital discharge 


Medical-Surgical 


3,587 


61 


33 


N/A 


190 (5.3) 


242 (6.7)° 


Ouanes 


2012 


France 


7 days 


Medical-Surgical 


3,462 


61 


38 


SAPS II (35) 


74 (2.1) 


28 (0.8) 



APACHE, Acute Physiology and Chronic Health Evaluation; ICU, Intensive Care unit; N/A, Not Available; SAPS, Simplified Acute Physiology Score; UK, United Kingdom; USA, United States of America, 
e Readmission to ICU following patient discharge from ICU. 
C Hospital mortality following patient discharge form ICU. 
u Data from derivation cohort. 

§ Mixed ICUs: Medical, Medical-Surgical, Surgical, Trauma, Neurological, Cardiac, Cardiovascular. 
P Median value. 

y Range of median ages for the derivation and validation cohorts, 
t Point score estimated from predicted risk of death (percentage). 

a Sensitivity analyses restricted to unexpected deaths produced the same mortality percentage. 



Table 2 Risk stratification tools 



Author, 
Tool, Country 
Year 


Tool Components/ 

Variables 
(Weighting/Points) 


Prediction Outcome 
(Follow-up) 


Tool 
Development 
(# patients) 


Tool 
Validation 
(# patients/ 

#ICU) 


Sensitivity 

(%) 


Specificity 

(%) 


LR+ 


LR- 


AUROC 
(95% CI) 


Gajic 


Source of ICU admission 


Readmission 


Multivariate 


Internal 


56 


83 


3.09 


0.56 


0.75 


'SWIFT Score' 


(Other than ED: 8 pt) 


(7 days) 


(1,131) 


(783/1) 


27 


87 


2.13 


0.84 


(0.70 to 


USA, 2008 


ICU length of stay 






External 










0.80) 




(2 to 10 d: 1 pt, >10 d: 4 pt) 






(708/1) 










0.70 



o „ 



Frost 
Australia, 2010 



Reini 
Sweden, 2012 



Badawi 
USA, 2012 



Daly 
United Kingdom, 
2002 



Fernandez 
'Sabadell Score' 

Spain, 
2006 and 2010 



Last measured Pa02/Fi02 ratio 
(150 to 399: 5 pt, 100 to 149: 10 pt, < 1 00: 
13 pt) 
GCS at ICU discharge 
(1 1 to 14: 6 pt, 8 to 10: 14 pt, <8: 24 pt) 
Last PaC02 (>45 mmHg: 5 pt) 

Age (years: 0 to 8 pt) 
Male (2 pt) 
Elective admission (12 pt) 
Admission source 
(ED: 9 pt, Other hospital: 10 pt, Ward: 15 
Pt) 

APACHE II score (0 to 20 pt) 
ICU length of stay >7 days (17 pt) 
After hours discharge (4 pt) 
Renal failure (10 pt) 

Pulse rate (0 to 3 pt) 
Respiratory rate (0 to 3 pt) 
Systolic blood pressure (0 to 3 pt) 
Level of consciousness (0 to 3 pt) 
Temperature (0 to 2 pt) 

23 variables 1. 



26 variables 5 



P coefficients 1 " 
Age per year (0.0532) 
Chronic Health Points (0.2501) 
ICU length of stay per day (0.0447) 
Acute Physiology points (0.1556) 
Cardiothoracic surgery (-2.104) 
Constant (-4.5821) 

Subjective intensive care physician 
scoring: 
Good Prognosis (0) 
Poor long term prognosis, >6 months (1) 
Poor short term prognosis, <6 months (2) 
Death expected within hospitalization (3) 



Readmission 
(Hospital Discharge) 



Readmission 
(72 hours) 



Readmission 
(48 hours) 

Mortality 
(48 hours) 

Mortality 
(Hospital Discharge) 



Mortality 
(Hospital Discharge) 



Multivariate 
(14,952) 



Existing Score 



Multivariate 
(469,967) 

Multivariate 
(469,967) 

Multivariate 
(5,475) 



Existing Score 
Modified 



Internal* 
(14,952/1) 



External 
(518) 



Internal 
(234,976/219) 

Internal 
(234,976/219) 

Internal 
(1,136/1) 
External 
(7,313/19) 



Internal 
(1,521/1) 
External 
(3,587/31) 



n/a 



n/a 



85" 



6 to 96 v 1 9 to 99 v 



74 



23 to 87 
26 to 85 



79 to 99 
71 to 99 



n/a 



1.19 to 
5.72"" 



47 to 82* 87 to 99 ¥ 6.44 to 
55* 



2.55 



4.14 to 23 
2.93 to 26 



n/a 



0.99° 



0.19 to 
0.95" 

0.20 to 
0.53* 

0.37 



0.16 to 
0.78 

0.21 to 
0.75 



(0.64 to 
0.76) 



0.66 
(n/a) 



OR 0.98 
(0.69 to 
1.37) 1 



0.71 
(0.71 to 
0.71) 

0.92 
(0.92 to 
0.92) 

0.80 
(0.79 to 
0.81 ) e 



0.88 
(0.84 to 

0.93) 

0.84 
(0.81 to 

0.87) 



< 9 



o 



Table 2 Risk stratification tools (Continued) 



Ouanes 
'MIR' 

France, 
2012 



P coefficients* 
SAPS II (admission) (0.017) 
Central venous catheter (0.74) 
SIRS (max) (0.61) 
SOFA (discharge) (0.19) 
Discharge at night (0.92) 
Constant (-5.59) 



Readmission or mortality 
(7 days) 



Multivariate 
(3,462) 



(3,462/4) 



Internal* 



50 to 96' 



■a 



19 to 82' 



1.19 to 
2.78 a 



0.21 to 

o.6 r 



0.74 
(0.68 to 
0.79) 



APACHE, Acute Physiology and Chronic Health Evaluation; AUROC, area under the receiver operating characteristic curves; ED, emergency department; GCS, Glasgow Coma Scale; ICU, Intensive Care unit; LR, 
likelihood ratio; MIR, Minimizing ICU Readmission; N/A, Not Available; SAPS, Simplified Acute Physiology Score; SIRS, Systemic Inflammatory Response Syndrome; SOFA, Sequential Organ Failure Assessment score; 
SWIFT, Stability and Workload Index for Transfer; USA, United States of America. 
± Resampling using bootstrap techniques. 

6 Calculated using the Modified Early Warning Score on admission to ICU of <6 vs. >6. 

1! Odds ratio for readmission to ICU within 72 hours of ICU discharge reported for each one point increase in the Modified Early Warning Score at the time of ICU discharge. The receiver operating characteristic 
curve not reported. 

X Readmission model variables: Admission characteristics (age), Elective surgery, ICU type. Admission diagnosis category, Admit source, ICU visit number, Body mass index, ICU interventions (number of lactate values 
in 24 hours, ICU length of stay), Last day labs, (serum bicarbonate, white blood cell count, serum creatinine, hemoglobin). Last day physiology (heart rate, respiratory rate, diastolic blood pressure, systolic blood 
pressure, percent oxygen, most recent Glasgow coma scale score). 

y Range of sensitivities and specificities reported for four different thresholds of predicted readmission or mortality following ICU discharge ranging from 1% to 10%. 

§ Mortality model variables: Admission characteristics (age, body mass index), Operative diagnosis (elective surgery), ICU interventions (ICU length of stay, ventilation status), Last day labs (serum lactate, serum 
creatinine, white blood cell count, serum glucose), Last day physiology (diastolic blood pressure, heart rate, mean arterial pressure, respiratory rate, percent oxygen saturation, most recent Glasgow coma scale score), 
t p coefficients reported from multivariable regression model. 
0 AUROC reported for combined data for internal and external validation cohorts. 

a Range of sensitivities, specificities and likelihood ratios reported for four different thresholds of the MIR score. 



Table 3 Description of study quality 



Study 


Year 


Cohort 
timing 


ICU 

# 


Ethics 
approval 
reported 


Follow-up 
complete 


Demographics 
described 


DNR 
Patients 
included 


Comorbidities 
assessed 


Type of 
analysis 


SOI 
score 
used 


Eligibility 
criteria 
mentioned 


Power 
calculated a 
priori 


Study 
duration 
justified 


Limitations 
discussed 


Gajic 


2008 


Prospective 


1 


Yes 


Yes 


Yes 


No 


No 


Multivariate 


Yes 


Yes 


No 


No 


Yes 


Frost 


2010 


Retrospective 


1 


Yes 


Yes 


Yes 


No 


Yes 


Multivariate 


Yes 


Yes 


No 


Yes 


Yes 


Reini 


2012 


Prospective 


1 


Yes 


Yes 


Yes 


Yes 


No 


Multivariate 


Yes 


Yes 


No 


Yes 


Yes 


Badawi 


2012 


Retrospective 


219 


Yes 


Yes 


Yes 


No 


No 


Multivariate 


Yes 


Yes 


No 


Yes 


Yes 


Daly 


2001 


Retrospective 


20 


Yes 


Yes 


Yes 


Yes 


No 


Multivariate 


Yes 


Yes 


No 


No 


No 


Fernandez 


2006 


Prospective 


1 


No 


Yes 


No 


Yes 


Yes 


Multivariate 


Yes 


Yes 


No 


Yes 


Yes 


Fernandez 


2010 


Prospective 


31 


No 


Yes 


Yes 


Yes 


Yes 


Multivariate 


Yes 


Yes 


No 


Yes 


Yes 


Ouanes 


2011 


Retrospective 


A 


Yes 


Yes 


Yes 


No 


Yes 


Multivariate 


Yes 


Yes 


No 


Yes 


Yes 



DNR, Do Not Resuscitate; ICU, Intensive Care unit; SOI, Severity of Illness 
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physicians can be overconfident in their predictive abilities 
[17-20]. Independent risk stratification may provide clini- 
cians with additional information to guide clinical deci- 
sion-making, but further evaluation is required. To 
complicate matters, patient populations can vary substan- 
tially between ICUs (for example, multisystem ICUs vs. 
subspecialty ICUs) suggesting that development of a tool 
that can be broadly applied across patient populations 
may be difficult [21]. 

Third, it is unknown whether implementation of a risk 
stratification tool can improve processes and outcomes of 
care for patients. Laupacis et al. outlined three evaluation 
criteria for clinical prediction rules [22]. One, the tool 
needs to be validated to provide evidence of reproducible 
accuracy. Two, the tool needs to have sufficient predictive 
power to provide clinicians with confidence to use the 
results to guide decision-making. Three, the tool needs to 
be actually used by clinicians (easy to use whether using 
memory, paper-based tool or electronic tool) to change 
behavior and improve patient outcomes. Ideally, an ICU 
discharge risk stratification tool would forecast patient 
outcomes and, therefore, facilitate the delivery of safe (for 
example, reduce premature ICU discharge for high risk 
patients), effective (for example, target transition resources 
to high risk patients) and efficient (for example, expedite 
ICU discharge for low risk patients) care. The first two 
evaluation criteria are satisfied to varying degrees by the 
tools identified in our review. However, prior to imple- 
mentation, an impact analysis demonstrating evidence that 
risk stratification changes physician behavior and improves 
patient outcomes is needed [22] . 

Our study has limitations. First, relevant studies may 
have been missed despite using comprehensive search 
strategies and the assistance of an information specialist 
to search multiple databases. Second, our study was lim- 
ited to reviewing studies of existing risk stratification 
tools. We are, therefore, unable to comment on studies 
that did not include tools but that may contain evidence 
that warrants the development of new tools. Third, we 
identified a small number of studies with heterogeneous 
populations that measured different outcomes, which 
limited direct comparison of risk stratification tools. 

Conclusion 

In summary, risk stratification of patients discharged from 
ICU is a complex process with many potential challenges. 
Several risk stratification tools have been developed with 
the MIR score and the Badawi and Breslow mortality tool 
appearing to be promising. However, at present it is 
unclear whether existing tools provide value above clini- 
cian judgment, or whether they can be used to improve 
healthcare delivery. Further evaluation of existing tools is 
required prior to clinical implementation. 



Key messages 

• Transition of patient care from ICU is a high-risk 
and challenging transition that is associated with 
severe adverse events. 

• Tools to stratify patient risk of readmission or 
death following discharge from ICU have been 
developed, but are not ready for clinical application. 

• Additional comparative evaluations of tool repro- 
ducible accuracy are needed as well as impact ana- 
lyses demonstrating evidence that risk stratification 
changes physician behavior and improves patient 
outcomes. 

Additional material 

' N 

Additional file 1: Appendix A. MEDLINE Search Strategy. The list of 
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